Search AI Products and News

Alibaba's Tongyi Lab recently released a new digital human video generation model called "OmniTalker." This innovative model allows for precise imitation of a person's expressions, voice, and speaking style by simply uploading a reference video. Compared to traditional digital human production workflows, OmniTalker significantly reduces production costs while enhancing the realism and interactive experience of the generated content, meeting a wide range of application needs. OmniTalker is easy to use; users only need to...

Recently, an innovative technology named LHM (Large-scale Human Model for Animation) has achieved a significant breakthrough in the field of 3D human body reconstruction, bringing new development directions and application prospects to the field. Reconstructing animatable 3D human bodies from a single image has been a highly challenging task, plagued by ambiguities in geometry, appearance, and deformation separation. Current state-of-the-art research mostly focuses on static human modeling, and these methods often rely on synthetic 3D scans for training, which greatly limits their applications in...

Alibaba has announced the launch of its flagship AI application, New Quark. Built upon Alibaba Tongyi's leading reasoning and multimodal large models, New Quark is a comprehensively upgraded, boundless "AI Super Box." New Quark boasts powerful reasoning capabilities and enables multimodal interaction, allowing users to interact with AI in real-time. The AI will think and act based on user needs, continuously adjusting strategies to ensure task completion. This innovative design provides users with both convenience and an engaging experience.

On March 13th, Alibaba officially launched its AI flagship application—New Quark. This newly upgraded Quark, built upon Alibaba Tongyi's leading reasoning and multimodal large models, creates a boundless AI Super Box, offering users a brand-new AI experience.

Still lamenting the high barrier to entry for video production and the complexities of post-editing? Fear not! Alibaba's Tongyi Wan team has launched their latest heavyweight model: the All-in-One video generation and editing model—VACE. One of VACE's most striking capabilities is its powerful conditional video generation function. This means you only need to describe your desired scene in text, and VACE will quickly transform your imagination into reality. It's like having a dream film crew at your command, with astonishing efficiency!

AI agent tool Manus announced a strategic partnership with Alibaba's Tongyi Qianwen to launch a Chinese version. This collaboration will leverage Tongyi Qianwen's open-source model and utilize domestic computing platforms to implement Manus' full functionality, aiming to provide Chinese users with a more convenient and efficient AI application experience. Manus is a project incubated by the startup Monica.im, founded in July 2023, which focuses on developing consumer-oriented AI tools and browser extensions. The founding team...

Against the backdrop of rapid advancements in artificial intelligence, research and applications of AI large models are booming. Recent developments from various companies and institutions in this field have garnered significant attention. Firstly, Nvidia's price-to-earnings ratio before the launch of ChatGPT attracted considerable attention on Wall Street, with experts suggesting this might foreshadow a repeat of Apple's success story in 2008. Meanwhile, Yu Feng, CIO of Guotai Junan Securities, stated that the rise of AI large models will propel the securities industry into an era of "intelligent cognition".

Alibaba Tongyi Lab has open-sourced ViDoRAG, a novel visual document retrieval and question answering system. ViDoRAG boasts impressive accuracy, achieving a remarkable 79.4% in benchmark tests. This system represents a significant advancement in the field of computer vision and information retrieval.

Recently, Huggingface, the world's largest open source AI community, released the latest Open LLM Leaderboard. The results show that all ten of the top-ranked open source large models are derivative models that have been fine-tuned based on Alibaba Tongyi Qwen's (Qwen) open-source model. This achievement marks Qwen's dominant position in the open-source AI field and further enhances its global influence. The Open LLM Leaderboard is widely...

The Qwen team recently announced the open-source release of their latest multimodal reasoning model, QVQ, marking an important step forward in the capabilities of artificial intelligence in visual understanding and complex problem-solving. This model is based on Qwen2-VL-72B and aims to enhance AI reasoning capabilities by combining language and visual information. In the MMMU evaluation, QVQ achieved a high score of 70.3, demonstrating significant performance improvements over Qwen2-VL-72B-Instruct in several math-related benchmark tests.

The Alibaba Tongyi Laboratory voice team announced that its open-source voice generation model CosyVoice has been upgraded to version 2.0. This upgrade marks significant progress in voice generation technology in terms of accuracy, stability, and natural experience. CosyVoice 2.0 achieves bidirectional streaming voice synthesis through the integration of offline and streaming modeling techniques, allowing for a first-package synthesis delay of up to 150ms, thereby significantly improving the responsiveness of voice synthesis.

On November 15, Alibaba Tongyi Lab launched the Code Mode, a feature that enables users to generate various applications through simple everyday language instructions, including mini games, data charts, websites, and resumes. Users can experience this new interactive method by visiting the Tongyi web version (tongyi.ai) and clicking on 'Code Mode' in the input box.

On August 30, 2024, Alibaba Damo Academy's Tongyi Qianwen team announced a significant update to its latest achievement—the Qwen2-VL model. The Qwen2-VL model has achieved remarkable improvements in image understanding, video processing, and multilingual support, setting new benchmarks for key performance indicators.

In the early hours of today, Alibaba's Tongyi Qianwen team released the Qwen2 series of open-source models. This series includes pre-trained and instruction-tuned models in five sizes: Qwen2-0.5B, Qwen2-1.5B, Qwen2-7B, Qwen2-57B-A14B, and Qwen2-72B. Key information indicates that these models show significant improvements in parameter count and performance compared to the previous generation Qwen1.5.

Alibaba's Tongyi Laboratory has released an AI animation project called Animate Anyone, which generates animated videos of characters using just a static image and skeletal animation. Cats dancing to 'Tie Shan Kao' have become a viral sensation online.

The Alibaba Tongyi Laboratory open sources the AI image generation fine-tuning framework SCEdit. The SCEdit framework supports fine-tuning for image generation tasks and demonstrates high efficiency in generation tasks. It achieves precise control in controllable generation tasks while saving training memory costs.